Constructive Proof of Global Lyapunov Function as Potential Function 
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We provide a constructive proof on the equivalence of two fundamental concepts: the global 
Lyapunov function in engineering and the potential function in physics, establishing a bridge be- 
tween these distinct fields. This result suggests new approaches on the significant unsolved problem 
namely to construct Lyapunov functions for general nonlinear systems through the analogy with ex- 
isting methods on potential functions. In addition, we show another connection that the Lyapunov 
equation is a reduced form of the generalized Einstein relation for linear systems. 
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The classical Lyapunov function [l|-[4[ has been widely 
applied in engineering for stability analysis though re- 
stricted for a specified fixed point. Constructing such 
functions for general nonlinear systems is of great theo- 
retical and practical interests but still a challenge 
that would require one's "divine inspiration" in applica- 
tion Q. We introduce in this letter a global Lyapunov 
function as the natural generalization of its classical local 
version. Inside a neighborhood of a stable fixed point, the 
global Lyapunov function usually reduces to a classical 
one. Moreover, it enables us to do quantitative analy- 
sis of complex dynamical behaviors far from equilibrium 
(e.g. multi-stable states and periodic attractors) which 
are ubiquitous in real systems [H, [s| but beyond the scope 
of the classical one. Research on a fundamental concept 
in physics, the potential function, has been motivated 
recently by uncove ring gl obal principles of complex dy- 
namics in biology [1CH13| . physics LJ, ll5| and control 
theory [l6|, 17 1 . One of the present authors has proposed 
a general construction of potential functions for stochas- 
tic dynamics 18, ljjj . It was first formulated during the 
study of the robustness of a stochastic switch [2(J. Ex- 
plicit results for fixed point [2l[ and limit cycle systems 
[22| have also been derived. We demonstrate here that 
the global Lyapunov function is actually the potential 
function, which connects engineering to physics and in- 
dicates systematic approaches for constructing Lyapunov 
functions. 

To avoid unnecessary mathematical complication, here 
we will only consider smooth dynamics. The present re- 
sults can be directly extended to more general systems. 
The definition of the classical Lyapunov function for a 
smooth system 

q = f(q), (i) 

where f : R" -> R" is given by 

Definition 1 (Lyapunov Function). Let q* be a fixed 
point for the system and L : O — > R a C 1 function defined 
on an open set O containing q* . Then L satisfying the 
following conditions is called a Lyapunov function. 



(a) L(q*) = and L(q) > if q ^ q* ; 

(b) i(q) = f | q ^0/ O r allqeO. 

(a) implies that the fixed point q* is a local extremum 
such that VL(q*) = 0. Although (a) is sufficient for the 
determination of stability, it seems too strict for a quan- 
tity with global meaning as well as applicable for complex 
dynamical behaviors. We have to amend this condition 
in order to contain at least saddle points. For such a 
purpose, we take the weaker form of (a): VL(q*) = 
for all fixed points q*, to fit our generalization. This 
together with (b) constitutes the definition of global Lya- 
punov function. 

Definition 2 (Global Lyapunov Function). Let ip : 

R" — > R be a C 1 function. Then ip satisfying the fol- 
lowing conditions is called a global Lyapunov function. 

(a) V-0(q*) = for all q* where q = f(q*) = ; 

f&Mq) = ^| q <0 for flllqei" . 

The global Lyapunov function is equivalent to the po- 
tential function obtained from the following proposed 
Canonical Form. 

The evolution of a deterministic dynamical system de- 
scribed by a set of differential equations can be consid- 
ered as a massless particle moving along the trajecto- 
ries inside the phase space. From a physical point of 
view, it is natural to explain the motion of this particle 
as a consequence of the underlying driving forces where 
F driving = mq = 0. These forces can be separated gener- 
ally in physics into a dissipative and a conservative part 

F driving — ^ conservative ~t~ ^ dissipative — 0- Without the 

loss of generality, we use a frictional force to represent 
the dissipative part F dissipative = — Sq and a Lorentz 
force together with an energy induced force as the con- 
servative part F conservaUve = eq x B + [-VV>(q)], thus 
Sq + eq x B — VV'(q) = where S is symmetric and 
semi-positive definite. 
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The semi-positive definite requirement for S guaran- 
tees the resistance of the frictional force whose valid val- 
ues are restricted to the negative half space. The poten- 
tial function ip here serves as an indicator demonstrating 
the influence of the other two forces onto the energy of 
the system. It is apparent that the energy induced force 
is equal and opposite everywhere to the resultant of the 
other forces as such 



Sq + eB x q = -Wip(q) 



(2) 



The work done by the frictional force is then the reduced 
amount of ip. 

However, a problem occurs for systems whose dimen- 
sion is higher than 3, since the cross product B x q is un- 
defined. In order to generalize (|2|) to be valid for arbitrary 
n-dimensional systems, we introduce a generalized form 
of this vector- valued cross product Bxqas Tq, where T 
is an antisymmetric matrix. This definition is consistent 
with the three dimensional case, since Bxq = Tq when 
Tij = —SijkBk and Sijk being the Levi-Civita symbol. 

Hence by setting e = 1, we reach 



[S + T]q=-W(q) 



(3) 



where S is symmetric and semi-positive definite and T is 
antisymmetric. ([3]) is referred to as the Canonical Form 
which induces n(n — l)/2 equations (utilizing the matrix- 
valued cross product in Definition [3]) : 



V x [{S + T) q] = . 



(4) 



Symmetrically, it is proper to require ip to be convert- 
ible back to its original system. This gives the Standard 
Form: 



q =-[D + Q] W(q) : 



(5) 



where D is symmetric and semi-positive definite, Q is 
antisymmetric. The connection between S, T and D is 
characterized by the generalized Einstein relation (GER) 
HQ: 



[S + T]D[S-T] = S, 



(6) 



This gives the other n(n + l)/2 equations. For a chosen 
D with proper boundary conditions, we obtain [S + T] 
(n 2 unknowns) by solving these n 2 equations provided by 
(|4]) and ([6]), then ip can be derived from 

Equation ((6]) demonstrates the general relationship be- 
tween friction and diffusion for stochastic dynamics fl9| . 
D is the diffusion matrix indicating the random driv- 
ing force. Deterministic system can be considered gener- 
ally as a stochastic system with the noise being zero in 
strength. For deterministic dissipative system, there ex- 
ists a frictional force that has the common origin with the 
undefined (by its differential equations) random driving 
force. This point is implied by the fluctuation-dissipation 
theorem [23f or more generally the equation 



Theorem 1. For a certain dynamical system, any po- 
tential function ip obtained from ^ is a global Lyapunov 
function. Conversely, explicit construction of S and T 
can be given for any global Lyapunov function of the sys- 
tem. 

Definition 3 (Matrix- valued Cross Product). The 

matrix-valued cross product of two vectors x, y £ R™ is 
given by x x y = A = (a lJ )„ xn = (xiyj - XjyA nxn . The 
output is no longer a vector but an antisymmetric matrix. 

Lemma 1. For arbitrary three vectors x, y, z G R™ (Note 
here the dot product and the matrix-valued cross product 
is precedent to the matrix multiplication) , 



x • yz = z • xy + z x yx . 



(7) 



The proof is straightforward since (z • xy + z x yx),; = 
J2k ZkXkVi + J2k( z iVk ~ ZkUi)x k = (x • yz)j. 

Proof of Theorem^ From ©, q = f(q*) = 
VV>(q*) = 0. Note that ^ip(q) = q T V</>(q) = 
-q T [5(q) + T(q)] q = -q T S(q)q < 0, we find that tj} 
satisfies ip ^ for all q <G R™. Hence if> is a global Lya- 
punov function according to Definition [2] 

Conversely, for any global Lyapunov function V'(q) °f 
a given system q = f(q), by setting 



S = 
T = 



E. 



vy> -f 

ff 

VV> x f 
ff 



(8) 
(9) 



by utilizing ■ f = V^> • q = ip ^ 0, S is symmetric and 
semi-positive definite and T is antisymmetric by the def- 
inition of the matrix- valued cross product. From Lemma 
[U we can obtain 



f • f VV> = VV> ■ ff + Vip x ff , 
by letting x = y = f and z = V^'- Then 
(VV; • fE + Vt/> x f ) f 



[S + T] q : 



f f 



(10) 



-Vijj. (11) 



When q = 0, since Vip = 0, the singularity of S and 
T will not affect ip. This demonstrates that any global 
Lyapunov function for a given system will satisfy ([3]) . □ 

Explicit construction for the chosen D and Q fulfilling 
([5]) and © can be provided under the former configura- 
tion of S and T utilizing the matrix- valued cross product, 



D = 



Q = 



ff 



v^-f 

V^xf 



:E 



(V0 x f) 2 



(v?/> ■ f) (vv> ■ vvo 



whose proof is straightforward by the Lemma [3J 



(12) 
(13) 
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Lemma 2. Vx,y G R n : 

(x x y) 3 = [(x • y) 2 - (x • x) (y ■ y)] (x x y) . (14) 
The proof is similar to Lemma [TJ 

We have proved the semi-positive definite property 
of D by considering q T L>q and completing the square. 
From equation (fl"2j) and (fl"3)) , we observe that points with 
ijj = Vip ■ q = Vip • f = may cause singularity. It can 
be proved that 

Theorem 2. The union of all the uj-limit sets |1/ for 
solutions starting from all points q in the phase space is 
denoted by S = Uq w (q)> then ip(q) = for all q G S. 

Proof. We apply proof by contradiction. If for a given 
point qo, V>(qo) < 0. Since ip and q = f (q) arc continuous 
diffcrcntiablc functions then ip = \Jip • q is continuous. 
So there exists an open set O as such for any q € O, 
y !>(q) < c < where c is a negative constant. 

Suppose qo G S, then there is a solution q(t) and a 
sequence ij, i G N, q(<i) G O and lim i ^ 00 q(t i ) = q . 
Since ip € C 1 and satisfies ip ^ 0, the trajectory L from 
q(ti) to q(tj + i) must have a segment AL C L fl inside 
0, we have 



^ (q(*i+i)) ~ V 1 (q(*i)) = H>dt= ijidt 

JL J L\0 

< cIIALII < 0. 



Hence {ip(q[t n ))} is a strictly monotonically decreasing 
sequence. By the continuity of ip, lim,;_ i . 00 ip(q(ti)) = 
V>(qo), thus 



^(q(ti)) > ^(<to),*GN. 



(15) 



Let qo(t) be the solution starting at qo- For any s > 
0, we have ^(cio(s)) < ip(qo). Since f G C 1 , then the 
solutions are continuously dependent on initial conditions 
0| . Therefore, for any solution q'(f) starting sufficiently 
near q , 3e > 

V>(q'(s)) - \ < ^(qo(s)) < V>(qo) - e => ?A(q'(s)) < V(qo) 

As a result, there exists adequately large n 

iiq{t n + «)) < V(q ) , (16) 

which conflicts with (Tl~5|) . Hence qo ^ 5. □ 

Discussions on singularity for fixed points and limit 
cycles are presented below. Such singularity is canceled 
sometimes by the numerator in (|12[) and (|13|) but un- 
avoidable for other cases where it exists, reflecting the 
nature of the dynamics. 

• All fixed points q* G S, for q(t) = q* is a trivial 
solution, thus leading to singularity of D. Since 
VV>(q*) = and q(q*) = 0, this type of singularity 
will not impact the potential function ip. 



• Points on limit cycles belong to S where ip = 0. 
Moreover, tp has to be equal-potential everywhere 
on a limit cycle fulfilling (jbj of the Definition [2] 
Together with the dissipation nature, we obtain 
V-0 = [22|. This demonstrates that on a limit 
cycle, the system is no longer dissipative but con- 
served. 

Intuitively, a global Lyapunov function for a determin- 
istic dynamical system will satisfy ip ^ 0, which indi- 
cates all possible places in the phase space when t — >• 00 
as the evolution converges. Therefore, such a function 
with ip < except an unavoidable set of singular points 
(e.g. points in S = U q w (q)) i s usually what we seek, 
providing a strongest prediction on the evolution result. 

Note that the construction is not unique. As the for- 
merly presented construction starts from ([3]) , we can sym- 
metrically provide another one from ([5]). Since [D 
Q]Vijj = — q, then based on Lemma 1, D = — 



fxVV; 



S = - 



vy>-vi> 



E 



(fxVi/i) 2 



(f-W)(f-f) 



and T = 



f f . The explicit constructions presented in this letter 
have not been discovered from similar frameworks such 



as 



171. These different constructions will not affect our 



equivalence result. 

Example 1 (Hamiltonian System). For Hamiltonian 
systems fH3 /. 



dH 

dpi ' 



dH dH 

dp n ' dqi ' 



dH 

dq„ 



-JVH, 



where J 



Thus it is apparent that ([5]) 



-E 
E 

satisfied with D — and ip = H , for J is antisymmetric. 
Then by letting T = — J and 5 = for energy conserva- 
tion, 



[S + T] q = Tq = - Jq = -VH = -Vip => ip = H . 

The global Lyapunov function is actually the Hamilto- 
nian. Therefore, the generalization of the vector-valued 
cross product in is appropriate. Besides, all systems 
discussed in pHj can be decomposed uniformly by this 
approach. 

Example 2 (Saddle Point System). The system 



x = x 

y = -y 



can be rewritten as 



[S + T] q 



1 1 \ I x 



-1 1 J V -v 



x + y 
x + y 



-VtP, 



with ip(x, y) = —\x 2 + xy + \y 2 ■ One can check that 



-[D+Qm = -( 1 1 



1 ( 1 -l \ f —x + y 

x + y 



= q 
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where D = \ 
i/>(x, y) is a glol 



1 OA , n i / -1 
Q 1 J and Q = ^ 1 Q 

! Lyapunov function for the system 



Thus 



The Lyapunov equation points another issue of our 
framework — the global Lyapunov function is usually 
non- unique for deterministic systems [25| : but a unique 
and quantitative measure once specifying the diffusion 
matrix D 18|. For linear systems q = Aq, if any two 



eigenvalues Aj and Xj of A satisfy Aj + Xj ^ then for 
any symmetric and positive definite matrix R, there is a 
unique symmetric and invcrtible matrix P fulfilling the 
Lyapunov equation Q 



A T P + PA + R = . 



(17) 



The system then has a global Lyapunov function L = 
q T Pq. If P is also positive definite, L will be reduced 
to a classical global strong Lyapunov function. Under 
such a configuration, we observe [S + T] = —2PA -1 , 
S = —PA^ 1 — (j4 t ) P, since A has no zero eigen- 
value. By setting D = jP~ 1 RP~ 1 , it is straightforward 
to prove that there is a one-to-one correspondence be- 
tween symmetric and positive definite matrices R and 
D. Hence, (|17|) is in fact the generalized Einstein re- 
lation (|6]) for these linear systems. This example clearly 
demonstrates that there are usually more than one global 
Lyapunov function for a system with different D. For a 
certain D, © will guarantee the uniqueness of the global 
Lyapunov function. 

Ordinary differential equations for a deterministic dis- 
sipativc system indicate only the property of dissipation 
along the trajectories without specifying the speed of dis- 
sipation. Thus, arbitrary speed is acceptable, leading 
to different global Lyapunov functions. Therefore, the 
global Lyapunov function obtained is merely a qualita- 
tive measure (a partial order, e.g. the function value of 
different stable fixed points are not comparable) but not 
quantitative. By indicating the diffusion matrix D which 
is in fact the microscopic description of dissipation, the 
details of the frictional force are provided. Hence, the 
speed of dissipation along the trajectories is provided, 
defining the global Lyapunov function as a unique quan- 
titative measure. This measure can be expressed as a 
Boltzmann-Gibbs distribution [l9| on the final steady 
state (if steady state exists) of the system's evolution. 

In conclusion, we have presented a global Lyapunov 
function that coexists with complex dynamical behaviors 
as the natural generalization of the classical Lyapunov 
function. We have provided a constructive proof on the 
equivalence of the global Lyapunov function and the po- 
tential function obtained through a physical treatment 
of general dynamics. This relationship suggests new ap- 
proaches on the construction of Lyapunov functions. Fi- 
nally, we point out that for linear systems, the Lyapunov 
equation is a reduced form of the generalized Einstein 
relation. 
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